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This paper introduces and analyzes the notion of throughput sub- 
optimality for many-server queueing systems in heavy traffic. The 
queueing model under consideration has multiple customer classes, 
indexed by a finite set T, and heterogenous, exponential servers. 
Servers are dynamically chosen to serve customers, and buffers are 
available for customers waiting to be served. The arrival rates and 
the number of servers are scaled up in such a way that the processes 
representing the number of class-i customers in the system, i £ X, 
fluctuate about a static fluid model, that is assumed to be critically 
loaded in a standard sense. At the same time, the fluid model is as- 
sumed to be throughput suboptimal. Roughly, this means that the 
servers can be allocated so as to achieve a total processing rate that 
is greater than the total arrival rate. We show that there exists a 
dynamic control policy for the queueing model that is efficient in the 
following strong sense; Under this policy, for every finite T, the mea- 
sure of the set of times prior to T, at which at least one customer 
is in the buffer, converges to zero in probability as the arrival rates 
and number of servers go to infinity. On the way to prove our main 
result, we provide a characterization of throughput suboptimality in 
terms of properties of the buffer-station graph. 

1. Introduction. In this paper, we study a class of many-server queue- 
ing systems in heavy traffic, that are critically loaded in a standard sense, 
but exhibit a behavior that is typical to subcritically loaded systems. We 
introduce the notion of throughput suboptimality for an underlying fluid 
model, and show that it plays a central role in determining and explaining 
this behavior. 
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The queueing model under consideration has multiple customer classes, 
indexed by a finite set T, and heterogenous exponential servers. The servers 
are grouped in pools, indexed by a finite set J ^ and it is assumed that 
each pool has a large number of servers that have identical capabilities. In 
particular, the rate, denoted by //jj, at which a server from pool j ^ J serves 
customers from class i £2, depends on both i and j. It is also possible that 
servers from pool j cannot serve class-i customers, in which case we write 
Hij = 0. The arrival of class-f customers is modeled as a renewal process 
with rate Aj, Servers are dynamically chosen to serve customers, and 

buffers are available to accommodate customers that wait to be served (see 
Figure 1). The model is considered in a many-server heavy traffic regime, 
in which the number of servers at each pool and the arrival rates are scaled 
up at a nearly fixed proportion, and in such a way that the processes that 
represent the number of class-z customers in the system, i G T, fluctuate 
about a certain static fluid model. This fluid model is assumed to be critically 
loaded, in a standard sense. In particular, (1) servers can be allocated in such 
a way that the total processing rate devoted to class-i customers is equal 
to the arrival rate A,, for every i G T; and (2) property (1) does not hold 
if one of the arrival rates Aj is replaced by some A^ > Aj (there are some 
further assumptions; see Section 2). It is possible for such a model to satisfy 
the following condition: servers can be allocated so as to achieve a total 
processing rate that is greater than the total arrival rate (see Section 2 for 
a precise statement). If this condition holds, we say that the fluid model is 
throughput suboptimal. Our main result (Theorem 1) shows that when the 
fluid model is throughput suboptimal, one can find a dynamic control policy 
for the queueing model that exhibits a strong form of efficiency: Under this 
policy, for every finite T, the measure of the set of times prior to T, at which 
at least one customer is in the buffer, converges to zero in probability as the 
arrival rates and number of servers go to infinity. Thus, although the system 
is critically loaded, its buffers are "essentially" empty, as if the system is 
subcritically loaded (see [5], Theorem 6.8(i), for a typical asymptotic result 
in a subcritical regime in diffusion scale, where the buffers are empty in the 
limit). 

This work is motivated by recent progress on scheduling and routing con- 
trol problems for many-server systems, and their diffusion-scale limits; see 
references cited in [1], Section 2.3.3. In many of these references, one at- 
tempts to find a dynamic routing policy that minimizes a given performance 
measure. Viewing these hard problems at a diffusion scale typically simpli- 
fies the task, because at the scaling limit the problem transforms into that of 
optimally controlling a diffusion process. Diffusion scale is natural because 
at this scale the primitive processes (associated with arrival and service) ex- 
hibit nontrivial random fluctuations. To explain how our result is related to 
this viewpoint, let n denote a parameter by which the number of servers and 
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Fig. 1. A queuemg model with four customer classes and three service pools. 

the arrival rates are scaled [as in (2.7); see Section 2 for the precise setting]. 
Denote the total queue-length of the nth system by Q" (starting in Section 2 
this process will be denoted by e ■ y"). A typical control problem is that of 
minimizing 

EUo Q"(*) dt], where Q" = n-^^gn^ diffusion-scale version of 
Q". Our result can be viewed as a contribution to this line of work. Indeed, 
assuming throughput suboptimality of the fluid model, it implies that there 
exists a policy under which, for every T < oo, the empirical law associated 
with Q"|[o,T] converges weakly to the unit point mass at zero, as n ^ oo 
(although it does not address an expected cost of the above type). However, 
we do not present the result in diffusion scale, because it is sharper and, in 
fact, establishes the above statement about the empirical law of the process 
Q"l[o,T] itself. 

A related analysis appears in [3], where the same model is proved to sat- 
isfy a stronger result under a stronger assumption. While the current paper 
addresses the capability to maintain a system with no customer in the buffer 
"most of the time," with large probability, the result of [3] concerns main- 
taining a system with no customers in the buffer "at all times" (apart from 
an initial transition phase), with large probability. More precisely, under 
appropriate assumptions, it is shown in [3] that there exists a policy under 
which, for every < e < T < oo, the probability that at least one customer 
is present in the buffer any time within [e,T] approaches in the scaling 
limit. This phenomenon is shown to be related, on one hand to a formula- 
tion of the limiting diffusion model as a diffusion with singular control [3], 
Section 3. On the other hand, it is shown to be related to a condition on 
the graph that encodes the network's structure. This graph has a vertex for 
each class z G X, a vertex for each server pool j G J, and an edge, with an 
associated weight Hij, between a class vertex i and a pool vertex j if, and 
only if fiij > 0. The assumption of [3] is the existence of a cycle p in this 
graph, having a negative total signed weight, iJ,{p), where the (p-dependent) 
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signs of the weights fiij are appropriately defined [as in equation (3.1) in 
the current paper; see also equation (3.2) for a definition of fi{p) as the sum 
of the signed weights along p]. We will show that the algebraic condition 
alluded to above is a special case of the main assumption of the current 
paper, namely throughput suboptimality. We will also characterize the lat- 
ter condition in terms of the graph and the signed weights, and show that 
throughput suboptimality may occur in one of two ways: The existence of 
either a cycle or an open path p (appropriately defined) , with signed weight 
fi{p) < (Theorem 2). 

We make two further remarks about the relation to [3]. First, the differ- 
ence between having no customers in the buffer for a given period of time 
[e, T] (as in [3]) and having no customers in the buffer most of the time 
within [e,T], may be significant with regard to the queue-length perfor- 
mance measure. In fact, under the policy constructed in the current paper, 
there are short time periods in which large queues build. We believe that a 
result of the type of [3] is not possible under the conditions of the current 
paper, but we do not prove this claim. Second, the results of [3] allow for 
both preemptive policies (where service to a customer can be interrupted 
and resumed at a later time, possibly at a different server) and nonpreemp- 
tive ones (where service cannot be interrupted), while the current paper only 
treats preemptive policies. We leave open the question of whether analogous 
results are possible for the nonpreemptive case. 

The results of [3] and the current paper reveal two aspects of a phe- 
nomenon, where critically loaded many-server systems behave as subcriti- 
cally loaded. As our main result shows, the notion of throughput suboptimal- 
ity captures this phenomenon. It is reasonable to expect that this connection 
continues to hold in a wider family of critically loaded many server models, 
with more general structure. 

The main tool in analyzing the probabilistic model is a related determin- 
istic dynamic fluid model, that roughly replaces stochastic fluctuations by 
deterministic ones. Throughput suboptimality is shown to have an effect on 
this model that is similar to the one discussed above, where quantities that 
represent queue-lengths are shown to be small, in an appropriate sense (see 
Theorem 3). The proof of the result relies on the graph-theoretic character- 
ization alluded to above, and specifically uses the existence of a path p with 
the property //(p) < 0. The result for the probabilistic model follows from 
the deterministic one in a relatively straightforward way. 

The organization of the paper is as follows. Section 2 contains the descrip- 
tion of the model and assumptions, and the statement of the main result. 
Some numerical examples are given at the end of this section. Section 3 
provides an algebraic characterization of throughput (sub) optimality. The 
dynamic fluid model is introduced in Section 4. A property for this model 
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that is analogous to the main result is proved, based on the results of Sec- 
tion 3. Relying on the deterministic model results, we provide in Section 5 
a proof of the main result. 

Notation. Write N for the set of positive integers, Z+ for the set of non- 
negative integers, and M+ = [0, oo). For a real number a, let a+ = max{0, a}, 
a~ = — min{0,a}. For a positive integer d and x € M'^ , let ||a;|| = X]f=i l^d- 
For v.u^W^lei V- u — X]i=i ^i^^i- The symbols denote the unit coordinate 
vectors and e = The dimension of e may change from one expres- 

sion to another. Denote by ©(M'^) the space of all cadlag functions (i.e., right 
continuous and having finite left limits) from to W^. Endow B(]R'^) with 
the usual Skorohod topology (cf. [4]). If X", n G N, and X are processes 
with sample paths in ©(R*^), write =^ X to denote weak convergence 
of the measures induced by X" [on B(M'^)] to the measure induced by X. 
Denote \X\l = supo<„<j |X(ti)| for X G D(M) and \\X\\l = supo<„<t ||X(n) || 
for X E]D)(M'^). 

2. Setting and main result. 

2.1. Probabilistic queueing model. A precise description of the queueing 
model is as follows. A complete probability space (0,^, P) is given, sup- 
porting all stochastic processes defined below. Expectation with respect to 
P is denoted by E. The queueing model is parameterized by n G N. It has / 
customer classes and J service stations. Station j has Nj' identical servers. 
The classes are labeled as and the stations as /+ 1, ...,/+ J: 



Arrivals are modeled as renewal processes with finite second moment for 
the interarrival time. More precisely, we are given parameters A" > 0, i G X, 
n G N, and independent sequences of strictly positive i.i.d. random variables 
{Ui{k), k G N}, i G T, with mean EJJi[\) = 1 and squared coefficient of vari- 
ation = (S[/i(l))"2 Var({7i(l)) G [0,oo). With Ya = 0, the number of 
class-i arrivals up to time t at the nth system is given as 



For i I, j J and n G N we are given parameters /i^- > 0, representing 
the service rate of a class-i customer by a server of station j. There is a 
possibility for = 0, in which case we say that class-i customers cannot be 
served at station j. For every {i,j) £X x J', we denote by ^'^■(i) the number 
of class-i customers being served in station j at time t. By definition. 



I={1,... 



1} 



J={I + l,...,I+J}. 




t>0. 



(2.1) 



for {i,j) s.t. /x" =0. 



6 



R. ATAR AND G. SHAIKHET 



Service times are modeled as independent exponential random variables. 
To this end, let Sfj, € X x J', be Poisson processes with rate //^- (where 
a Poisson process of zero rate is the zero process), mutually independent 
and independent of the arrival processes. Let T[j{t) denote the time up to 
t devoted to a class-i customer by a server, summed over all servers from 
station j, and note that 

T^^{t) = j\':^{s)ds, iel,jej,t>0. 

The number of service completions of class-i customers by all servers of 
station j by time t is, by assumption, given by Dfj(t) := S^j(T^j{t)). See [3] 
for explanation on the exponential service time property of this model. We 
refer to = {D^j,{i,j) (zl x J') as the departure process. The processes 
A"" and will be referred to as the primitive processes. 

Denoting by Xf'lt) the number of class-i customers in the system at time 
t, and setting X- = X"(0), it is clear from the above that 

(2.2) xnt)=x^'''+Ant)-Y.s?,(fms)ds), iei,t>o. 

For simplicity, the initial conditions X^'^ are assumed to be deterministic. 
Finally, we introduce the processes Y^^ (t) , representing the number of class- 
i customers that are in the queue (and not being served) at time t, and 
Z^{t), representing the number of servers at station j that are idle at time 
t. Clearly, we have the following relations: 

(2.3) Y:^{t) + Y.mt)=xnt), i^^, 

(2.4) z7(o+Enw=^;' j^j- 

Also, the following holds by definition: 

(2.5) yrW>0, ^;(t)>0, ^'r,(i)>0, iel,3^J:t>Q. 

Equations (2.1)-(2.5) indicate some properties of the processes involved, 
but they do not characterize these processes, because the process has 
not yet been described. As reflected in the following definition, we regard 
as a control process that can be obtained as "feedback" from the "state" 
process X" and the arrival process . 

Definition 1. Fix n. We say that a process = i'^i'jYj^j where, for 
(i,j) G T X J7, takes values in Z+ and has right-continuous paths, is a 
scheduling control policy (SCP) if the following conditions hold: 
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(i) Given initial data X^'^ and primitive processes and S"", there exist 
processes X", and with values in Z^, and Z^, respectively, 
such that (2.1)-(2.5) are met; 

(ii) For every t>0, ^"(t) is measurable on (t{X"'(s), A"(s) :s < t}. 

Note that uniqueness of the processes X", y" and Z", given A^', 5"" and 
is immediate from (2.2)-(2.4). Note also that according to this definition, 
service to a customer can be stopped and resumed at a later time, possibly 
in a different station. 

We will use some elementary graph theoretic terminology and notation 
as follows (see, e.g., [6] for standard definitions). For a nonempty set V and 
E QV X V, we write G = {V, E) for the graph with vertex set V and edge 
set E. A vertex having exactly one neighbor is called a leaf vertex, and an 
edge joining a leaf vertex is called a leaf edge. A connected graph that does 
not contain cycles is called a tree. 

We denote the index set for all customer classes and service stations by 
V :=I U J^, and the set of all class-station pairs hy £ :=I x J. Some of 
the elements (i, j) of £ correspond to class-station pairs where station j can 
serve class i. We encode this information by setting 

(2.6) £:a = {(i,i)GJx >0}, 

where throughout we assume that £^ does not depend on n. A class-station 
pair (i,j) G <?a is said to be an activity. Throughout, if £i is a subset of £, 
we write £i for the complement of £i with respect to £. The set of class- 
station pairs that are not activities is denoted by £^^ = £ \ £a.. We denote 
Ga_ = (V,<Sa)i and refer to it as the graph of activities. 

2.2. Static fluid model: heavy traffic and throughput optimality. 

Heavy traffic condition and related assumptions. We will assume that 
the parameters of the probabilistic queueing model satisfy certain conditions 
that indicate that the system is critically loaded. To specify these conditions, 
we will introduce a deterministic, static fiuid model, defined in terms of a 
simple linear program. 

We assume that there are constants Aj,i/j € (0,oo), i G T, j € ^7, and 
Hij € (0, oo), {i,j) G (^a, such that 

(2.7) n~^N^^Uj, jej, 

We set fj^ij = for (i,j) E £!^. [Later on we strengthen (2.7) above; cf. As- 
sumption 3.] 
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Consider a fluid model, where the arrival and service processes are re- 
placed by deterministic flows with corresponding rates Aj and fiij. There are 
/ classes of incoming fluid and J processing stations (while for the prob- 
abilistic queueing model we used the terms class-i customers and service 
station j, for the current model we use class-i fluid and processing station 
j). Station j has capacity to hold i^j units of fluid. When station j contains 
tfjij units of class-i fluid, for all i G X and j S J^, the rate at which class-i 
fluid is processed at station j (and leaves the station) is The overall 

rate at which class-i fluid is processed (and leaves the system) is J2j f^iji'ij- 
Let E be the set of / x J matrices ^ with ^ij > 0, (i,j) G £, and J2iCij ^ 1) 
j G For ^ G H, will represent the fraction of the service capacity from 
station j allocated to process class-i fluid. We call an element of H an allo- 
cation matrix. The fluid model uses a fixed allocation matrix for all times 
(hence the term "static" model). Set fiij = HijVj, {i-,j) G £. Note that is 
equal to the amount of class-i fluid contained in station j, normalized by the 
capacity of station j, namely ipij/uj. Consequently, fiijil^ij = flij^ij- Consider 
the following linear program: 

Find (i,i) G £} and p G M+ so as to minimize p subject to 
(2-8) E% <P, J € J, 

For p G [0, 1] , a ^ as above is clearly an allocation matrix. The first line of 

(2.8) expresses that the system is balanced, in the sense that for each i, the 
total processing rate of class-i fiuid equals the rate at which fiuid of this class 
enters the system. We will assume throughout that the system is critically 
loaded, in the following sense. 

Assumption 1. There exists an optimal solution {^*,p*) to the linear 
program (2.8), satisfying J2ieiCii = 1 all j ^ J (and consequently p* = 
1). 

This assumption is weaker than the heavy traffic condition of [7] where 
the optimal solution is assumed, in addition, to be unique. Throughout the 
paper, we fix satisfying Assumption 1, and also let 

(2.9) ^:j=Qj^j^ < = T.%^v i^^.i^J- 

j 

The following simple relations follow directly from the above assumption: 

(2.10) ^V^^-x*, E^*:; = ^^' >^^ = T.^'v^^J^ ieijej. 
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The quantity 'ip*j represents the amount of class-i fluid that station j contains 
(and processes), under the allocation matrix and x* represents the total 
amount of class-i fluid being processed. 

Following [7], an activity G fa is said to be basic (resp., nonbasic) 
if > (resp., = 0). Define the graph of basic activities Qha to be the 
subgraph of Qs, having V as a vertex set, and the collection 



of basic activities as an edge set. The following will be assumed throughout. 
Assumption 2. The graph ^ba is a tree. 

Under the heavy traffic condition of [7], alluded to above, Assumption 2 
above is known [8] to be equivalent to the complete resource pooling condition 
[3, 7], of which one of the equivalent formulations is that all vertices in J 
communicate via edges in C/bai expressing a strong mode of cooperation 
between the service stations. Note that the combination of Assumptions 
1 and 2 forms a weaker assumption than the combination of the heavy 
traffic and complete resource pooling conditions (assumed, e.g., in [3]). It is 
possible for the linear program to have multiple optimal solutions, and it is 
only required that one of them satisfies the tree structure. 

Throughput optimality. Assumption 1 expresses critical load on the sys- 
tem, in the sense described earlier, but it does not exclude the possibility 
that the total processing rate can exceed the total arrival rate. Namely, it 
is possible that there exists an allocation matrix ^ under which 



is of interest. Under these allocation matrices, for each i £ I, the total 
amount of class-i fluid being processed does not exceed that under ,^*. A 
condition involving simultaneously (2.11) and (2.12) will be key in this pa- 
per. We will say that the static fluid model is throughput optimal if the 
following holds: 



{(i,i)efa:a>0} 



(2.11) U^Ji^l>Y.^^■ 



{i,j)&£ i&I 



The set of allocation matrices ^ € H that satisfy 



(2.12) iijVj < X* for alH G T 



(2.13) 




iji^j <x* Mi £ I, 
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We will say that the static fluid model is throughput suboptimal if it is not 
throughput optimal. 

When the static fluid model is throughput suboptimal, one can find € H 
meeting (2.11) and (2.12). Recall that x* represents the amount of fluid of 
each class being processed in all stations. Thus, when (2.13) fails to hold, one 
can keep the same amount of fluid of each class as under , and redistribute 
it among the stations so as to obtain a greater total processing rate than 
under Note, however, there is no guarantee that under ^ the processing 
rate is sufficient for handling arrivals of all classes. Namely, it is possible 
that 

(2.14) there is a class i e2 for which ^ P-ij^ij < -^i) 

and thus a use of ^ may result in instability. [It is not hard to see that in the 
case where the optimal solution to the the linear program is unique, (2.14) 
holds for any £,* ■] In the probabilistic queueing model, however, one can 
vary the allocation over time, and the existence of ^ as above turns out to 
have a crucial impact. This is expressed in Theorem 1 below, which is our 
main result. 

The following assumption regards the second order behavior of the pa- 
rameters and initial condition. 

Assumption 3. There is a constant c < oo such that for ah i £l, j e J 

and n € N, 

(2.15) jn~^Ar -X^\y - V |n"^iVf - x*\ < cn~^/^. 

Theorem 1. Let Assumptions 1-3 hold. If the static fluid model is 
throughput suboptimal, then there exists a sequence of SCPs, under which 
for any fixed < T < oo and g > 1/2, 

fT 

(2.16) J ^{eY"{s)>o} ds ^ in probability, asn—^oo, 

(2.17) n~^||X" ^0 in probability, as n^oo. 

Remark 1. Assumption 3 could be somewhat relaxed by replacing 
the bound on the last term in (2.15), namely \n~^X^'^ — xl \ < cn~^^'^, by 
(n-iX°'" - X*) < cn-^^"^, n G N, i € T, so as to cover cases where the initial 
load on the system is sub critical. There is a simple argument by which this 
can be deduced from Theorem 1, where one introduces virtual customers 
at time zero, thus increasing the value of so that (2.15) holds, and 
Theorem 1 is in force. We leave out the details. 
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The main idea of how throughput suboptimahty is used in the proof of 
Theorem 1 is as fohows. Recall that when the static fluid model is throughput 
suboptimal, one can find an allocation matrix ^ G H under which the total 
processing rate is strictly greater than the total arrival rate J2i ■ 
probabilistic queueing model, we can interpret this condition by saying that 
when, for each j, the proportion of pool-j servers allocated to class i is 
(roughly) ^jj, the system operates with a total service rate that exceeds the 
total arrival rate. Since (2.14) may hold, a constant use of such proportions 
for a long time might result in instability, in the sense that at least one 
of the queues must build up. Therefore, such a strategy will not achieve 
(2.16). A slightly more sophisticated strategy is one that alternates between 
policies (i) and (ii), as follows, (i) Use, as above, proportions according to ^, 
until the system reaches a state where the total number of customers is less 
than the total number of servers, but possibly with some queues building 
up; (ii) Rearrange customers in the system so that all buffers are empty. 
This is made possible because the number of customers is less than the total 
number of servers, and the vector of normalized numbers of customers is 
close to X* [note also that (2.12) is necessary because in the rearrangement 
process (ii), the total number of servers allocated to serve class i is limited 
by the number class-i customers in the system]. Then use a control that 
merely keeps the buffers empty for some time. The proof shows that this 
can be done in such a way that the length of the time intervals where (i) is 
applied are much shorter than those where (ii) is applied, so that (2.16) is 
achieved in the limit. 

In order for our argument to be valid, there must exist an allocation 
matrix ^ which achieves the inequality that is a part of the definition of 
throughput suboptimahty, namely that under ^, the total processing rate 
exceeds the total arrival rate. That, of course, does not imply that through- 
put suboptimahty is necessary for the validity of (2.16), and so the question 
of whether a converse to our main result holds, is left open. We intend to 
address this question in future work. 

2.3. Examples. We demonstrate throughput suboptimahty by some nu- 
merical examples. 

Example 1. Consider the following static fluid model in heavy traffic, 
with 2 classes of customers and 3 stations 

^=(j)' ^=(4)' ^ = ^"^=(? 2)- 
The resulting optimal static allocation is as follows (2.9): 

?) - ...(-). 
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To see that the static fluid model is throughput suboptimal, let e > be 
sufficiently small and consider the allocation matrix 

P_fl-£ 0.5 + e 0\ 
^ 0.5 -e l)' 

Clearly, we have J2j dj^j = for every i. However, J2(i,j)<^£ Cijfiij > Ai + A2. 
Thus, the condition of throughput optimality (2.13) is not satisfied. The 
result of Theorem 1 holds. We note that the assumptions of [3] are also 
valid in this example. See more information on this example at the end of 
Section 3. 



Example 2. In this example, the data is the same as in Example 1 
above, except for one entry: 

3 10 1 
4 2 




^= Li ' f^ = f^ 



The resulting optimal static allocation is as follows: 

/I 0.5 0\ ^*_A-5 

^ ~^ ~ lo 0.5 ir U.5 



With e > sufficiently small, the matrix 



l-e 0.5 + e 
0.5 -e 1 

is an allocation matrix. Moreover, J2j ^ij^j = J2{ij)&£ djAij > Ai + A2. 

Thus, the static fluid model is throughput suboptimal. As shown in the end 
of Section 3, the conditions of [3] are not satisfied for this example. 



Example 3. Consider 

A= I 1 I , 1^ = ^- 





4 


0.5 


1 


1 


0.5 


4 



The resulting optimal static allocation is as follows: 

/I 0.5 \ 

^* = 0.5 0.5 and x* = 
\0 0.5/ 

The static fluid model for this example is throughput optimal, as we show 
at the end of Section 3, using the tools we develop in Section 3. 
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3. Characterization of throughput optimality. The main result of this 
section (Theorem 2) characterizes throughput optimahty in terms of some 
graph-theoretic properties of the network. To state it, we need some defini- 
tions. 

Recah that by Assumption 2, the graph ^ba is a tree, and because by 
construction, it is a subgraph of Gg,, all its edges are of the form (i, j) where 
i G X and j € J^. In the definition below and elsewhere in this section, it 
will be convenient to identify (i,j) with (where i €T and j € J') when 
referring to an element of the edge set £. Although the notation is abused, 
there will be no confusion since X and J' do not intersect. 

Definition 2. (i) A subgraph q= {Vq,£q) of Gha. is called a basic path 
if one has Vg = {ioJo, ■ ■ ■,'ik,jk}, and 

= {(«o, jo), (io,ii), ■ • ■ , {ikjk)} 

where A; > 1 and io, ■ ■ ■ , ik S jo, ■ ■ ■ ,jk ^ <J are 2 A; -I- 2 distinct vertices. 
Note that every edge of a basic path is a basic activity (i.e., an element of 
fba)- Denote by BP the set of basic paths. Basic paths are used in this paper 
mainly in order to define simple paths, as follows. 

(ii) Let the leaves zq and jk of a basic path q be denoted by i'^ and, 
respectively, j''. The pair could be an activity (an element of £'a), 

in which case it is necessarily a nonbasic activity (i.e., an element of Sg, \ 
£'ba), and we say that the graph {Vq,£q U is a dosed simple path; 

otherwise [i'^,]'^) is not an activity (i.e., it is in and we say that q itself 
is an open simple path. We say that p is a simple path if it is either a closed 
or an open simple path. Denote by CSP and OSP the sets of closed and 
open simple paths, respectively, and by SP the set of simple paths. For a 
path p G SP, we write Vp and £p for its vertex and edge sets, respectively. 
Finally, if p is a simple path, let q^ G BP denote the corresponding basic 
path g, and let i^ and € J denote the leaves i'^ and j'^ of q^ . 

Note that \i p = (Vp,£'p) is a simple path and q^ = {Vq,£q) is its corre- 
sponding basic path, then Vq = Vp, and £q = £p \ {{i^,j^)}- 

Next, we associate directions with edges of simple paths. Let p be a sim- 
ple path and let q = q^ = {Vq,£q) be the corresponding basic path. Write 
£q = {{ioJo), • • • , {hJk)}, where iQ,...,ik&T and jo, • • • ,jk e J- The direc- 
tion that will be associated with the edges in £q, when considered as edges 
of p, is as follows: jk ik jk-i ik-i ■ ■ • ^ jo ^ io- In the case of 
an open simple path, this exhausts all edges of p. In the case of a closed 
simple path, the direction of {i^,j^) = {io,jk) is jk- We note that an 
edge (corresponding to a basic activity) may have different directions when 
considered as an edge of different simple paths. We signify the directions 
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along simple paths by s{p,i,j), defined for i & j £ J', € £p, p G SP, 
as 




— 1, if considered as an edge of p, 

is directed from i to j, 

1, if considered as an edge of p, 

is directed from j to i. 



We will denote 



(3.2) ^^{p)= siP^hj)lJ'ij, ^ex. 

Theorem 2. Let Assumptions 1 and 2 hold. Then the following state- 
ments are equivalent: 

1. The static fluid model is throughput suboptimal. 

2. There exists a simple path p E SP such that ^{p) < 0. 

Condition (2.13) is stated in terms of the variables {iij}- It will be con- 
venient to work with the variables {4>ij} in the proof below. To this end, 
recall that Uj > for all j and ip^j = HjVj. Thus, the negation of (2.13) can 
be written as follows: There exists 

(3.3) V = (V'*i)}|^, i^ij eR+,iel,j€j, 

satisfying 

(a) ^ ipij < Vj for all j G J, 

(3.4) (b) ^ all ^ ^ ^' 

(c) Y lJ'iji^ij>Y^i- 

Proof that statement 2 of Theorem 2 implies statement 1. 
Assume that statement 2 holds and fix a simple path p with ^{p) < 0. Let 
q = he the corresponding basic path, and recall that i/j^j > for {i,j) € £g. 
Denote 

(3.5) a = min ip*^ > 0. 
For each {i,j)GlxJ'we define 



(3.6) 



aij = -as{p,i,j) if {i,j) G £p, 
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and (Tij = otherwise. Let 

(3.7) Vii = iPtj + <ytj for {i,j)elx J. 

To show that statement 1 of the theorem holds, let us show that ijj satisfies 
(3.3) and (3.4). For ^ £p, = i^lj > 0- For G S^, 

i'ij > ipij - a > 0, 

by (3.5). In the case where p is an open simple path £p = £q, and (3.3) 
follows. In the case where p is a closed simple path, it is left to show that 
i^ipjp > 0. Recall that the direction associated with (i^,j^) is ■ Thus, 

by (3.1) and (3.6), il^ivjp >'ip*pjp = 0, establishing (3.3). 

Next, if p is a closed simple path then every vertex v of it has exactly two 
neighbors along p, say, v' and v" , and the directions of the corresponding 
edges are v' ^ v and v v" . Hence, by (3.1) and (3.6), J2jej'^ij = holds 
for every i £l, and X^igj '^ij = holds for every j £ J . The term Oivp , which 
is positive in the case when p is closed, is in fact zero in the case when p is 
open, thus yielding J2jeJ^ij — ^ every i and J2i£i^ij ^ for every 
j G i7. Since ^jJ* satisfies (3.4)(a) and (b), it follows from (3.7) that so does 
tp. Finally, by (3.7) and since (3.4) (c) holds for tp* with equality, it suffices 
to prove 

(3.8) HijGij > 

to establish that -0 satisfies (3.4) (c). By (3.6) and (3.2), 

XI fJ'ijcrij = -a flijs{p,i,j) = -a^J,{p)>0, 

where the inequality follows from (3.5) and the assumption /i(p) < 0. This 
establishes (3.8) and completes the proof that statement 2 implies statement 
1. □ 

In the rest of this section, we prove that statement 1 of the theorem 
implies statement 2. Define 

(3.9) M{a):= ^ fujaij, 

for any matrix a € . Let S denote the set of cj € satisfying the condi- 
tions 

(3.10) Y ^ij ^ * ^ ^' H ^ ^ ^' 

jej iei 

(3.11) ^P*,+aij>0 for all ii,j)e£. 



16 R. ATAR AND G. SHAIKHET 

and 

(3.12) aij = for all e^a- 
Note that S is nonempty and compact, and let 

(3.13) Mmax = max{M(cj) : cj G 5}. 
The following is straightforward. 

Proposition 1. Under the assumptions of Theorem 2, the condition 
-^max > is equivalent to the throughput suboptimality of the static fluid 
model. 

Remark 2. The above result is useful in checking whether the static 
fluid model is throughput suboptimal, by simply solving the linear program 
(3.10)-(3.13) and checking if M^ax > 0. 

Throughout what follows, let statement 1 hold. Proposition 1 implies 
-/Wmax > 0. Let 5opt (resp., 5+) denote the set oi a £ S such that M{a) = 
Mmax [resp., M{a) > 0], and note that 5opt and are nonempty. For a G 
5+, consider the graph = {Va^E^j), where 

(3.14) E„ = {{i,j)e£,:a,,^0} 

and Va = {i £ I: (i,j) € some j} U {j £ J' : {i,j) G E^j, some i} consists 
of all corresponding vertices. Since M{a) > 0, we have: 

(3.15) there exists (i,j) G E^j with aij > 0. 
By (3.10) and (3.14), 

(3.16) if {i,j) is a leaf edge of then aij < 0, 
and 

if (i.j) G E„ and an > then there exist two edges 

(3.17) - *J 

(«, jo), (ioJ) e £'<xWith aigj < and aij^ < 0. 

Definition 3. Let a e S+ be given. A subgraph g = {Vg,£g) of the 
graph Ga is called a good path for a, if it satisfies the following conditions. 

(i) (Connectivity) All vertices in Vg communicate via the edges in £g. 

(ii) The degree of each vertex is at most 2. 

(iii) The number of edges is at least 3. 

(iv) (Alternating signs) Whenever {ii,j), {i2,j) ^ E(^, one has Oi\,j(^i2,j ^ 
0; whenever (i, ji), (i, J2) G E^, one has ^i,j\^i,j2 

<0. 
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(v) (Maximality) Whenever g is a subgraph of some subgraph g' of Ga, 
and g' satisfies properties (i)-(iv) above, one has g' = g. 

It is not hard to see that observations (3.15) and (3.17) about the graph 
Ga imply that whenever a £ S-^, there exists at least one good path for a. 

Let o" € 5+ be given. For any edge (z, j) G So-, define Sfj{i,j) = — sign((Tjj) 
and for any good path g for a set 

(3.18) n{a,g):= ^ Sa{i,j)fiij. 

We write Sc (resp., So) for the set of all a G S'opt for which there exists a 
good path (resp., there exists no good path) g for a that is a cycle. The letters 
C and O are mnemonics for closed and open. Note that S'opt = Sc^ So- We 
also set 

So = {{f^,g) -cr £ Sc and 5 is a good path for a that is a cycle}, 
5o = {(o", 5) : cr € So and g is a good path for a that is not a cycle}. 

Lemma 1. Let {a,g) € So- Write g = {Vg,£g), where 

Vg = {Vl, . ..,Vk}, £g = {(-^1,^2), • • • , {Vk-l,Vk)}, 

and vi,...,Vk are distinct elements of V^- Then a^^^^y < for every edge 
{vi,v) G £^0-! (iiT'd similarly (Tv^v^ 

<0 for {v,Vk)£E^. 

Proof. Argue by contradiction and assume that ay^^y^ > 0. By (3.17), 
{vi,V2) must have a neighbor {vq,vi) with vq j^V2, satisfying < 0. It 

is easy to see that if we had vq GVg, there would exist a good path for 
a that is a cycle, violating the assumption of the lemma that there exist 
no such good paths for a. Define a new graph g' by Vgi = VgU {vq} and 
£gi = SgU {vo,vi), and note that it is a good path (cf. Definition 3). This 
contradicts the maximality property [Definition 3(v)] and, therefore, one 
must have ay^^y^ < 0. The second leaf edge {vk-i,Vk) is treated similarly. 

To prove the second statement of the lemma, let vq 7^ V2 be such that 
vq €Va, {vo,vi) € Efj. Argue by contradiction and assume that cr^Q^tjj >0. 
Since we already proved that 0"^i,u2 < 0' again use the assumption 

that there is no good path for a that is a cycle to conclude that ^V^- 
Defining g' by Vgi = Vg U {vq} and £gi = SgU {vo,vi) produces a good path 
that contains g, contradicting property (v) of Definition 3. Hence, o"^o,fi 

<0. 

□ 

Lemma 2. Let {(7,g) & Sc U So- Then there exists a set SPg C SP of 
simple paths, such that 

(3.19) K<^,g)= E I'ip)- 

P&SPg 
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Proof. Consider first the case where {cr,g) G Sc- Write g = iVg,£g) and 
let 7° G be defined by 

(o nn\ ^0 _ / sign(<Tij), if (i, j) G £g, 

"to, otherwise. 

By (3.18) and (3.20), we have 

(3.21) M(70)= ^fjf'ij= E sign{cTij)f-iij = -K<^,9). 

The following property is due to (3.20) and the fact that 5 is a good path 
for a that is a cycle: 

(3.22) for any f G X and j G ^7 we have ^ -y^j = and ^ jfj = 0. 

Define a finite sequence Y' G recursively as follows. Given 7*", if there are 
no nonbasic activities (i.e., elements of £'a\£'ba) in the set of edges where 7^ is 
supported then terminate, and set R = r. Otherwise, select such a nonbasic 
activity, and let pr denote the (unique) closed simple path containing it as 
an edge. Define 7*"+^ G by 

.3 23^ r+1 ^hij + ^(Pr^id), if (i, j) G ^Tp, , 

1 ^Ij, otherwise. 

For <r < R, the selected nonbasic activity at step r is (i^'' (using the 
notation from Definition 2). By the discussion following Definition 2, the 
direction for this activity is i^'' j^"" , and thus by (3.1), we have that 

(3.24) 7[,f = llj - 1, where = (i^^r)- 

Given a nonbasic activity (i,j), let r be the first r' for which is the 
selected nonbasic activity at step r' (if such r' exists). Since the transforma- 
tion (3.23) modifies 7 only at basic activities and at the nonbasic activity 
selected at the given step, it follows that ^y^j = 7ij- Hence, by (3.11), (3.14) 
and (3.20) that 7°^ = 1. Thus, (3.24) shows that 7[j"^ = 0. As a result, the 
support of 7^+^ contains one nonbasic activity less that that of 7^. It follows 
that R < 00. Thus, 7^ is well defined and supported on basic activities. 

Next, since by construction, the selected simple paths are closed, it follows 
by the linearity of the transformation (3.23) that (3.22) holds for each 7*^, 
and in particular, for 7^. It also follows from the linearity of (3.23), using 
(3.2), that M(7''+i) = M{Y) + n{pr) for < r < i?. Hence, 

(3.25) M(7^) = M(7°) + X:V(p.). 

r=0 
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The fact that 7 is supported on basic activities and that these form a tree 
(cf. Assumption 2), combined with the fact that 7^ satisfies (3.22) imphes 
that 7^ = 0. Hence, M{'y^) = 0, and using (3.21) and (3.25), we obtain 
(3.19). 

Next, consider {(T,g) € Sq- Then g = {Vg,£g), where 

Vg = {vi,...,Vk}, £g = {{vi,V2),...,{Vk-l,Vk)}, 

and vi,...,Vk are distinct elements of V^. First, note that either {vi,Vk) € 
I X J' or {vk,vi) X J'. Indeed, by Lemma 1 and properties (iii)-(iv) of 
Definition 3, \£g\ is an odd number, while having both vi and belong to 
either I 01 J would result with an even number for \£g\. 

Also, we claim that [vi^Vk) G £^- Argue by contradiction and assume that 
^J'Vl,v,, > 0. If we had o"t,j^t,j. > 0, then by Lemma 1, ay-^^y^ < ^'^d '^vk-i,vk < 0) 
and there would exist a good path, which is a cycle. This is prohibited 
since {(7,g) G So- Hence, (T^i,,;^. < 0. Set 6 := min{|(Tt,j^^2 1; |o'iife_i,i)fe 1} de- 
fine a new matrix a' G by assigning = cr^^^y^ + 6 and a'^j = aij for 
(i,j) & £ \ {{vi,vi^)}. By the definition a' satisfies (3.10)-(3.12) (see also 
Lemma 1), which implies M{a') = M{a) + d/iyj^^yf, > M{a). This contradicts 
the assumption a G Sopt- Therefore, = meaning (fi,ffc) G £^. 

The rest of the argument is similar to the treatment of the case where 
{cr,g) G Sc, with some modifications as follows. Instead of (3.20), consider 
7° G defined as 

r sign((Tij), if G £g, 
(3.26) 7^°=0, if{i,j) = {vi,Vk), 

[ 0, otherwise. 

Since {vi,Vk) is not an activity, /i^i,i>j. =0, and thus (3.21) is still valid. 
Also, it follows from Lemma 1 that 7^^ = 7vk._i,Vk as a result, 

(3.22) is valid. We can now repeat the construction of {7^}, <r < R, and 
the inductive argument that leads to (3.25). The matrix 7^^, in this case, 
is supported on basic activities plus the edge {vi,Vk)- Denoting by p the 
open simple path whose leaves are vi and Vk, we apply one last time a 
transformation of the form (3.23) as follows: 

lij + s{p,i,j), if{i,j)e£p, 
7/^-1, ii{i,j) = iP',f)^{vi,Vk), 

7j^, otherwise. 

As a result, 

M(7«+^) = M(70) + X;V(Pr) + A^(p). 

r=0 
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Arguing as before, we obtain that 7^+^ is supported on basic activities, 
satisfies (3.22) thus vanishes. Hence, M(7^+^) = 0, and (3.19) follows as 
before. □ 

Lemma 3. Let {cr^g) G Sc^Sq- Then the following statements are true. 

(i) M(f^,ff)<0. 

(ii) If fi{a,g) =0 then there exists a' G 5opt satisfying E^ji E^. 

Proof. We first prove part (i). Consider first the case where {cr,g) G Sc- 
Arguing by contradiction, assume fi{cr,g) > 0. Let 

(3.27) a= min \aii\>0, 

and for each {i,j) G E„ define 

a[j = aij + S(j{i,j)a ii{i,j)G£g, and cr'^j = (^ij otherwise. 

(3.28) 

We show that a' satisfies conditions (3.10)-(3.12) and, therefore, that a' G 
S. To this end, note that the sums in (3.10) remain unchanged under the 
transformation from a to a', due to the fact that g is a cycle and using 
the alternating signs property [Definition 3(iv)]. Thus, (3.10) is satisfied by 
a'. The relation (3.11) follows from (3.27) and (3.28), since a^j > aij for 
(i,j) G £g with aij < and cr'^j > for (i,j) G £g with aij > 0. The relation 
(3.12) holds trivially. This shows a' G S. We have 

{*,i)6£ (i,j)&£g 

(3.29) 

= M{a) + afi{a,g). 

Since fi{a,g) > by assumption, we have M(cj') > AI{a), which contradicts 
the assumption a G 5opt. Hence, (i) holds. 

Consider now the case where {(7,g) G So- Argue by contradiction and 
assume that n{(7,g) > 0. Define a' as in (3.27)-(3.28). Once again, we claim 
that the constraints (3.10)-(3.12) are satisfied for a' . The argument following 

(3.28) applies, and it remains only to check (3.10) for the vertices vi and 
Vk- The validity of (3.10) in this case follows from (3.27), (3.28) and Lemma 
1, since we have a^-^^y^ < 0, CFvk_i,Vk < fj-^ < holds for all {i,j) G £g 
with aij < 0. This shows that a' (z S. The rest of the argument is as in the 
previous case. 

Next we prove part (ii). The desired a' is, in fact, the one constructed in 
the proof of part (i). Indeed, we have proved that a' G S. Moreover, since 
n{a,g) = and a G S'opt, we have by (3.29) that a' G Sopt- By (3.27) and 
(3.28), 

a[iji = for all {i' G argmin \(Jij\, 



THROUGHPUT SUBOPTIMAL MODELS 
and, therefore, statement (ii) holds. □ 



21 



Proof that statement 1 of Theorem 2 implies statement 2. Let 
a € ^opt- Let g be such that {a,g) € 5'cU5o- Set {a^,g^) = {(T,g) and define 
a finite sequence {a^,g^) € 5c U recursively as follows. If fi{a^,g^') < 
then set R = r and terminate. Otherwise, by Lemma 3(i), iJ,{a'^ ,g^') = 0. Let 
a^~^^ denote the matrix a' from Lemma 3(ii) corresponding to {a^ ,g^). Since 
^r+i ^ g^^^ = Sc^ So, it follows from the definition of Sq and Sc that there 
exists g such that {a^'^^,g) S S'c U Sq- Let g^'^^ be such a good path. 

The finiteness of R follows from Lemma 3(ii) and the finiteness of the set 

By construction, {a^,g^) E 5c U 5o and fi{a^,g^) < 0. Lemma 2 thus 
implies that there exists a simple path p such that fi{p) < 0. This concludes 
the proof of the theorem. □ 

We end this section by revisiting the three examples from Section 2.3. 
We can now use Theorem 2 to determine throughput suboptimality for each 
example. 

Example 1. The simple path p corresponding to Example 1 of Sec- 
tion 2.3 (see Figure 2, left) satisfies fj,{p) = —4 < 0. Hence Theorem 1 applies. 
Moreover, p is a closed simple path, and one checks that [3], Theorem 2.3, 
is valid, also. 

Example 2. In the case of Example 2 of Section 2.3, the simple path 
p is open (see Figure 2, right). We have iJ,{p) = —3 < 0. Theorem 1 applies. 
Since p is open, [3], Theorem 2.3, does not apply. 

Example 3. To see that the static fluid model of Example 3 of Sec- 
tion 2.3 is throughput optimal, we use Proposition 1 and solve the linear 
optimization problem (3.10)-(3.13), to find that Mmax = 0. Hence, through- 
put optimality holds. 



4. Dynamic fluid modeL As a tool for analyzing the probabilistic model, 
we consider a model with deterministic arrival and service rates, and deter- 
ministic perturbations. The model is a deterministic analogue of a model 
that will be studied in Section 5, which corresponds to our original prob- 
abilistic model at fluid scale [see equations (5.3)-(5.9)]. The deterministic 
model that we now introduce will be referred to as a dynamic fluid model. 
It consists of cadlag functions Xi, Yi, Zj, ^ij, Wi, i(zl, j ^ J, satisfying 
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Fig. 2. Simple paths for Examples 1 and 2: On the leftp is a closed simple path, while on 
the right p is open. For Example 1, fi2i > and (2, 1) is a nonhasic activity. For Example 
2, fi2i = and (2, 1) is not an activity. 

the equations below, for all t > 0. 

(4.1) Xi{t) = X* + Wi{t) + - V ^L,, f ^i, (s) ds, i G I, 

(4.2) Yi{t) + Y,^ijit) = Xi{t), iel, 

(4.3) Zj{t) + Y.'^ij{t) = iyj + ej, jej, 

(4.4) ^i,(i) = o, (^,i)e4^ 

(4.5) Y,{t) > 0, Zj{t) > 0, ^^j{t) > 0, iei, jej. 

Above, the constants {x* , Xi, jiijjVj'ji £T,j £ J'} are as in Section 2, and 
{0j',j G l7} are additional real constants. We refer to {W,9) as data for the 
model. The term Wi is analogous to the process (5.8) of the probabilistic 
model, representing perturbations in the arrival and service processes that 
are eventually shown to converge to zero. The term corresponds to a 
discretization error due to the fact that the quantities Nj^ take integer values. 

Definition 4. Given cr > e > 0, we will say that the data {W, 9) for the 
dynamic fluid model (4.1)-(4.5) is an {e, a) -perturbation if 

(4.6) \\W{t)\\<e forallO<t<c7 and ||^||<e. 

Let Assumptions 1 and 2 hold and, in addition, assume that the static fluid 
model is throughput suboptimal. Let e > and cr > be given and assume 
that the data {W,6) is an (e, (7)-perturbation. Below we will construct func- 
tions {Xi(i),i€ J}, {Yi{t),ieT}, {Zj{t),jeJ} and {^,j{t),{i,j) elxj} 
that satisfy (4.1)-(4.5), such that l{e.r(s)>o} ds and ||-'^(t) — are o(l) 
as £ becomes small. The precise statement will be formulated in Theorem 3. 

Since the static fluid model is throughput suboptimal, we have from The- 
orem 2 that there exists a simple path p with /_i(p) < 0. Fix such a path p. 
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Set 

Sp={{hj) ^Sp:s{p,i,j) = 1}, £p ={{i,j) e£p:s{p,i,j) = -l}, 
and note that 

(4.7) fi{p) = s{p, i,j)fiij = S+ - Sp < 0, 



where 



In addition, set 



(4.8) S0:= /^v- 
Define the constant 

(4.9) a = i(l + S+/Ep-). 

The following inequalities follow from (4.7) and (4.9) 

(4.10) i<a<l, S+-aS- = i(S+-S-)<0. 

We will need the following result from [2], Proposition A. 2 (that follows from 
the tree structure of Sha.)'- the system of equations 

in the unknown (j) has a unique solution, whenever a and 6 satisfy J2i — 
Zjbj. With 

(4.12) DG = lia,b)eR' xR^:J2''i=J2 1 ' 

denote by G : Dq ^ M^^"^ the solution map, namely 

(4.13) 0,, = G,,(a,6), (i,j)ef, 
and note that this map is linear. Let 

(4.14) Cg :=sup|max|Gij (a,6)| : (a, 6) € Dg, \\a\\ V ||6|| < l|. 
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Recall that by the definition of basic activities, ip* has the property that 
ip*j > for G £:ba. Set 



(4.15) 5i = i min ^P*j>0, oq = (2Cg)-'<^i 



(4.16) 




if SO > 0, 



if = 0. 



By (4.10), we have < (^2 < <5i. 

Recall that there exists a simple path p with fi{p) < and let such p be 
fixed. Let (5 = /3(e) S be a constant matrix satisfying 

(4.17) |/?| := max <e2. 

Define the constant matrix G as 



(4.18) i^, 



{i,j)e£^n£^,. 

The term /3 will be required in Section 5 where the results are translated to 
the probabilistic model, in which the process takes integer values. 

Throughout, we use for e • X, and use a similar convention for x*,fe 
and 9e- 

We now explain the main idea of the construction. Recall that our goal 
is to come up with functions X, Y, Z, ^ satisfying the dynamic fluid model 
equations, where in addition, (i) the function Y takes the value zero "most 
of the time," and (ii) the function X is kept close to the quantity x* of the 
static fluid model. The construction will be based on alternating between two 
different behaviors. On intervals that will be denoted by [rjk-i,Ck), equation 
(4.20) will be in force. These intervals will be short, and the function Y will 
not necessary vanish on them, but they will achieve a quick reduction of the 
value of Xg, so that at the end of such an interval, X^ < 0. As a result, at the 
end of the interval, one will be able to find ^ with y = (because Xe < 
corresponds to the number of customers in the system being smaller than 
the total number of servers). The quick reduction of Xf, will be achieved by 
using an allocation matrix under which the total processing rate is greater 
than the total arrival rate (2.11), which exists, by throughput suboptimality. 
On intervals [Ck^Vk], equation (4.22) will be valid. These intervals will be 
relatively long. The deviation of ^ from the value ■0* of the static fluid model 
will be small, and as we shall prove this will achieve the closeness of X to x* . 
It will also be shown that the function Y, that starts at zero, is kept zero on 
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these intervals. The combination of the shortness of the intervals [r]k-i,Ck) 
and the vanishing of Y on the intervals [Ck^Vk] will finally yield the desired 
result regarding Y being zero most of the time (4.27). The construction of 
the functions is carried out in Lemma 4. In the proof of Theorem 3, the 
properties alluded to above are established. 

Fix io and jo € J. Set i]o = 0. Let A; > 1 and consider the system of 
equations (4.19)-(4.23): 



(4.19) 



T = fAa, f = inf{t > 0, \\X{t) -x*\\> e^/^} 



( X,{t) = Xi{7]k-i) + W^{t) - Wii7]k-i) + Kit - rjk-i) 



(4.20) 



where 
(4.21) 
and 

(4.22) 

where 
(4.23) 



*(t) = V^, 

Yi(t)=X,(t)-Y.^,,(t), 

Zj{t) = u,+e,-Y^-^i,{t), 



t £ [r)k-i,Ck), 
i€l, t£ [r]k-i,Ck), 

j ej, te [r]k-i,Ck), 



Ck = inf {t > %„i : Xe{t) - Xeivk^i) < -7e} A r, 



( x,{t) = XiiCk) + Wi{t) - WiiCk) + Xi{t - Ck) 

"^Hij '^ij{s)ds, ieI,t£[Ck,Vk) 

rr J Ch 



Y{t) = {X,{t)-v,-eeVei,,_ 

Z{t) = {Xe{t) -Ue-Oe) Cjo, i€[Cfc,%), 

I ^{t) = G{x{t) - Y{t),u + e - z{t)), t € [Ck,m), 



% = inf{t > Ck : \\X{t) - X{Ck)\\ > 3e} A r. 



Lemma 4. Assume that the data {W, 9) for the dynamic fluid model 
is an (e , a) -perturbation. Then for all e > sufficiently small, equations 
(4- 19)-(4-23) uniquely define a number t G (0,cr], a finite sequence %,Cfc 
and functions X,Y,Z and ^ on t ^ [O)''")- Moreover, these functions satisfy 
(4-l)-(4-5) on [0,r). 

Proof. In what follows, the functions X, Y, Z and ^ are constructed re- 
cursively. The fact that these functions and the number r, satisfying (4.19), 
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are uniquely determined by the data will follow by construction. The posi- 
tivity of r will follow from the bound Ci ^ proved in the paragraph that 
follows. 

Note next that if A; > 1 and %_i and X(r/fc_i) are given, then the first 
two equations in (4.20) define X and ^ uniquely on [r]k-i,Ck)- The last two 
lines of (4.20) define Y and Z on the same interval. Moreover, it is easy 
to see that equations (4.1)-(4.4) are satisfied on [0, Cfc), provided that they 
are satisfied on [0,r//c_i). The validity of the constraints (4.5) is argued later. 
Next, let Cfc and X{C,k) be given. Substituting into the first equation in (4.22) 
the values for Y, Z and ^ from the last three equations of (4.22) results with 
an equation of the form 

Xi{t)=Xi{Ck) + Wi{t)-Wi{Ck)+ f Fi{X{s))ds, iel, 

where are globally Lipschitz. This uniquely defines X, and in 

turn, Y, Z and ^ on [Ck,r]k)- Thus, X, Y, Z and ^' are uniquely defined on 
[0,r/fc), provided that they are on [0,Ck)- Let 

(4.24) K = inf{A;>0:r?fc=ror a+i=r}. 

We show that K < oo. To this end, observe that for e > sufficiently small, 
we have Ci > > 0. Indeed, if Ci = o", K = 0. Otherwise, (4.6), (4.3) and 

(4.5) imply the inequality ^ij{t) < Vj +e, and as a result, from (4.20) and 

(4.6) , it follows that for any < t < Ci, 

(4.25) |Xe(t)-Xe(0)| < ||X(t)-X(0)|| <2e + (ci + C2e)t, 

where ci = -^j + Yl,ij t^ij^j and C2 = Yl,ij f^ijj and the first inequality above 
is due to the relation |ae| = |ai + • • • + a^l < ||a||, a G M"'. By right-continuity 
of X and (4.21), we have that |Xe(Ci) - ^e(0)| > 7e. Thus, Ci > 5e(ci + 
C2s)~^ > for e sufficiently small. For k < K, denote 

(4.26) ll = [vk-i,Ck), ll = [Ck,Vk), h = ll^ll 

An argument similar to the one for C,i > shows that each of the intervals 
ll and /| has a length of at least e^. Hence, K is finite. The inductive 
argument given above thus shows that the functions X, Y , Z and ^ are 
uniquely defined on [0,r) and satisfy (4.1)-(4.4). We now show that the 
relations (4.5) hold. The two interval types are treated separately. 

Intervals l\: Let k and t G ll be fixed. By (4.20), ^'ij(t) is given by i/j, 
defined in (4.18). The nonnegativity of each ipij for all sufficiently small e 
follows from (4.15) and < 62 < Si [cf. (4.16)]. To show that Zj are nonneg- 
ative, note that by (4.20) and (4.18), 

Zj (t) = V, + % - 5] (t) = V, + 0j - ^ ^ij 
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>e,-C\P\+5i\{i:{i,j)e£;}\ 

-a5i\{i:{i,j)e£;}\+52\{i:{i,j)^ £p n ^ba} I , 

where C = |iSa|, and we have used (2.10) in the last Une. By Definition 2 
and (3.1), for any vertex j € ^7 in Vp, there exists exactly one edge, (ii, j) G 
£p, with s{p,ii,j) = 1, and there exists at most one edge {12, j) S £p with 
s{p,i2,j) = —1 (in the case where p is an open simple path and j is a leaf, 
such 12 does not exist). Thus, the positivity of 61, nonnegativity of S2 and 
the bounds on /? and 6 show that Zj{t) > (1 — a)5i — (C + l)e > for all e 
sufficiently small and j € J. 

Given z € X, by similar considerations, 

<x* + cm-5i\{j:{i,j)e£+}\ 

+ : (i, j) e£~}\- 62\{j : (i,j) G n ^ba}| 

<x* + Ce-{l-a)6i. 

Since t < r, we have by (4.19) that \\X{t)-x*\\ < e^/^. By (4.10) and (4.15), 
(1 - a)5i > 0. We conclude that Ejgj ^iji^) < ^iii), and in turn by (4.20), 
Yi(t) > 0, provided that e is sufficiently small. 

Intervals Fix /c and t £ l'^. The nonnegativity of Yi{t) and .^j(t) is 
immediate from (4.22). Also, (4.22) and (4.11) imply ^ij{t)=0 for G 
£'g^. It remains to show that ^'^^(t) > for (i,j) G .Sba- By (4.19), \\X{t) - 
x*\\ < dQ for t < r and e sufficiently small. By uniqueness of solutions to 
(4.11) and by (2.10), tp* = G{x* Also (2.10), (4.6), (4.19) and (4.22) 
imply that \\Y{t)\\ V \\Z{t)\\ < \\X{t) -x*\\+e for t < r. Hence, by linearity 
of the map G on the domain Dq (4.12), by (4.22) and (4.13)-(4.15), we have 

*»j(i) = Gij{x*,i^) + G,j{X{t) -X*- Y{t),e- Z{t)) 

> V'*, - CciWXit) -X*- Y{t)\\ V \\0 - Z{t)\\) 
>^*^-2CG{\\X{t)-x*\\+e) 

> - ^Ccao - 2Cgs 
= - <5i - ^Cce 
>0, 

where the last inequality holds by the definition of 5i (4.15) and provided 
that e is sufficiently small. This concludes the proof of Lemma 4. □ 

Theorem 3. Let Assumptions 1 and 2 hold. Assume that the static fluid 
model is throughput suboptimal. Then there exist functions 71 and 72 from 
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(0, oo) to itself, satisfying lim£_>o7i(£) = and lim£_,o 72 (e) = oo, such that 
the following statement holds. If the data {W, 6) for the dynamic fluid model 
is an [e, a) -perturbation, then the functions X, Y , Z and ^ that are uniquely 
defined by (4.19)-(4.23), satisfy 

(4.27) l{e.y(s)>o}'^s<7i(e), 

(4.28) ||X(t) <7i(e) /or a// < t < a A 72(e). 

The proof of the following lemma appears at the end of the section. 

Lemma 5. Recall the definitions of K (4-24) ^i^d intervals ll and /| 
from (4-26). There exist constants mi, m2, € (0,oo), not depending on 
e, a and k, such that for any k < K : 

1. \ll \ < mie; 

2. ||X - x*\\*^ < km2e; 

3. \ll\>m3/k. 

Proof of Theorem 3. We begin by showing that 

(4.29) Y{t) = ior all te[Ck,Vk),k<K. 
By (4.22), it suffices to show that 

(4.30) Xe{t)-Ue-ee<0 foT all t G [Ck, Vk) , k < K . 

Indeed, from (4.21), (4.6) and using = x* [by (2.10)], we have 

^e(Cl) -iye-Oe< X,(Cl) " X,(0) + (Xe(0) - xl) - 9^ < -7e + 8 - 6^ < -bs. 

Then by (4.23), taking into account the possibility of jumps of at most 2e 
for We, we have for t G [Cii ^i)- 

Xe{t) -Ve-0e< ^e(Cl) " I^e " + \\X{t) - X(Cl)|| < -he + 5e < 0. 

A proof by induction that repeats the above argument, using (4.21) and 
(4.23) shows that (4.30), and in turn (4.29), holds for k>l. 
Next, let us show that 

(4.31) r> a A 72(e), 

where 72(e) := ^| loge|, for sufficiently small e. Consider the number /cq = 
A;o(e) := [(2m2e^/^)"^] A K [where K is as in (4.24)]. If k^ = K and t = rjx 
then from (4.19), (4.24) and using Lemma 5(2), we have t = a, since then 
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< Otherwise, if ko = K and r = Ck+i, or /cq = [(2m2e^/^)~^], 
one uses (4.19), (4.24) and Lemma 5(2), (3) to obtain 

fco(e) 

X ^ m3 7713 

r>%o> 2^ > |loge|. 
1=1 * * 

Hence, (4.31) follows. 

Let Kq = -K'o(e) = maxj/c : Cfc < ^72(6)}. By Lemma 5(3), for sufficiently 
small e, 

Ko-l ^ 

A;-^ <mjS2(e) = -Tloge. 

k=i 

This implies that ^logK^ < — ;jloge, hence, Kq < e~^/^, provided that e is 
small. 

Now, using (4.29), Lemma 5(1) and the estimate on Kq, we have 

/•'7A72(e) 

l{e.y(s)>o} '^•5 < (-^o(e) + l)mie < 2mie ' < 71(e), 

where 71(e) := 2(mi V 1)6"'^/^, establishing (4.27). As a result of (4.19) and 

(4.31) , we obtain that 

||X(t) -x*|| <e^/2 for aU t <(j A72(e). 

As a result, ||^ - a;*||*/\^2(e) < ^^"^^^ + 2e < 71(e) • This shows (4.28) and com- 
pletes the proof of Theorem 3. □ 

Proof of Lemma 5. By (4.18) and (4.20), the dynamics of X on the 
intervals is given by 

(4.32) X{t) = X{rjk^^) + W{t) - W{r,k_,) + {t - r]k^i){r + b), 



where 



(4.33) 



and 



:= Ai - ^ - a6i ^ 



bi = bi{fi, (3) := - ^Ji-ijf3ij- ^ ^ijAj- 

By (2.10), (4.10), (4.15)-(4.16) and (4.33), we have 

(4.34) ^r, = 52S° + 5iS+ - q<5iS; < ^(5iS+ - a^iS;) < 0. 
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Note that by (4.6) and (4.1), |AXe| < 2e. From (4.20) and (4.21), and using 

(4.34) , we thus obtain for ij., k>l, 

-We < XeiCk) - Xeim-i) 

< WeiCk) - Weim-i) + {e-r + ||6||)(a - Vk-i) 
<2e + {e-r + cie^){Ck-Vk~i), 

for ci = J2ijf^ij^ where we also used (4.6) and (4.17). Therefore, for e 
sufficiently small, 

(4.35) \Ik\=Ck-r]k-i<rni£, 

where mi = 24/|e-r|. This proves part 1 of the lemma. 
From (4.32) and (4.35), for t £ I^. and sufficiently small e, 

\\X{t) - X{r]k-i)\\ <2e + C2{t - %„i) < (2 + C2mi)e, 

where C2 = 2||r||. We therefore have 

(4.36) sup \\X{t) - X(?7fc_i)|| < (2 + C2mi)e. 

tG[»7fc_i,Cfe] 

By (4.23), \\X{t) — X{C,k)\\ < 3e for all t G /|, and taking into account a 
possible jump at Tjk, we have 

(4.37) sup \\X{t)-XiCk)\\<5e. 

Since by (4.1) and (4.6), ||^(0) — < £, part 2 of the lemma follows from 
(4.36) and (4.37). 

In view of (4.22), (4.29) and (4.30), we have on 

(Y{t) = 0, 

(4.38) {Z{t) = -{X,{t) - i/e - 0e)e,o, 
[^ij{t) = Gi,{X{t),u + e-Z{t)). 

Define X{t) = X{t) - x*. From the definition of map G (4.11)-(4.13), we 
have 

Gij{Xit)+x*,u + e- Z{t)) 

(4.39) 

= G^,{x*,ij) + Gij{X{t) - e,ei,-Z{t)) + Gij{eeei,,e). 

Due to (2.10), we have Gij{x*,ij) =tpij- Now consider the second term in 

(4.39) . Using (4.38), 

Gij{X{t) - eeei„-Z{t)) = G^j{X{t) - 9,e^„{X,{t) -v,- 9,)ej,) 

(4.40) =Gij{X{t),Xe{t)ej,) 
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where we used Xf. = — Ve due to = z^g (2.10). Finally, from (4.38)- 
(4.40), we have 

*,,(t) = V'*. + Q,(X(t),Xe(t)e,J 

(4.41) 

+ Gij{—6eei^j,—6eejg) + Gij{9eeiQ,6), t^Ik- 
Define the map H by 

(4.42) Hi{x)■.= -^^lijGij{x,Xeej^), xGM^, iGJ, 

3 

and the constant by 

(4.43) Hf■.= -Y,^lij[Gij{-eee,,,-eeej,)+Gij{e^ei,,e)l iel. 

3 

By Assumption 1, J2j£j f^iji^ij = '^i- Hence, using (4.1), (4.38)-(4.43), we 
have 

x{t) = x(a) + w{t) - w{Ck) 

(4.44) 



+ / H{X{u))du + H\t-C^), tell, 

JCi- 



By (4.11)-(4.13) and (4.6), there exist constants ch > and Ih > 0, such 
that 

(4.45) ||i/(x)||<ci^||x||, \\H'\\<lHe, 

for e sufficiently small. Therefore, applying (4.6), (4.45) and Lemma 5(2) to 
(4.44), we have from (4.23) 

3e < \\X{r]k) - X{Ck)\\ = \\X{rjk) - X{Ck)\\ <2e + {cHkm2 + ///)(% - Ck)e, 
for an appropriate constant m2- The above implies 

e < {cHkm2 + /h)(% - Cfc)e- 

Therefore, for k>l 

(4.46) |/|l=^fc-a> , V , "i3:= <1, 

CHkm2 + Ih k C3CHm2 

where the constant C3 satisfies (03 — l)c//m2 > Ih, and where we assumed, 
without loss of generality, that Ih > ^ [cf. (4.45)]. This concludes the proof 
of Lemma 5. □ 
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5. Estimates on the probabilistic model. In this section, we prove The- 
orem 1. We begin by introducing a rescaled version of the processes defined 
in Section 2 as foUows. For n € N and t>0, let 

(5.1) Xnt)=n"'xr{t), y,"(t)=n-iy,"(t), iGl, 

(5.2) Z7(t) = n-iz;(t), mt) = n-'^^^{t), 

Denote X" = S I), and use a similar convention for y", and 

Following a straightforward calculation, relations (2.1)-(2.5) can be rewrit- 
ten in terms of the rescaled processes, as equations (5.3)-(5.7) below, holding 
for n G N and t > 0: 



(5.3) 
(5.4) 



(5.5) Yr{t) + Y.mt)=xnt) 



(5.6) ^(t)^Y.n^^) 



(5.7) 

where we set 



Yi{t) > 0, 
^S(i)>0, 



Z,(t)>0, 



(5.8) 



n 



^-(s)ds)-n< / *r,(^)ds 



+ (n-iX°'"-x*) + (n-U: 



1 \ n 



and 
(5.9) 



9'^ = n-^Nj 



The above equations resemble the dynamic fluid model studied in Section 4, 
and the proof of Theorem 1 will rely on the results of this section. 

Lemma 6. Under any SCP, for any givenTG (0,oo), {n-'^/^||W^"||^,n G 
N} are tight random variables. 
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Proof. Relations (2.4), (2.5) and (2.7) imply that < ^'^^(t) < ci, where 
ci is a constant independent of i,j,n and t. Hence by (2.15), the last 
three terms in (5.8) are bounded by C2{T + l)n~^/^, where C2 is a con- 
stant independent of i,j,n and t. Denote -A2{t) := n~^/^(^"(t) — A"t) and 
Sfj{t) := n-V2(5'n(nt) - nfi'ljt). Theorem 14.6 of [4] shows that {i^n G N} 
converges weakly to a Brownian motion (with zero mean and variance that 
depends on i), and that a similar statement holds for {S^j,n G N}. It follows 

that G N} and {l-Sj" j*^',?! G N} are tight random variables, for each 

whenever c is a constant that is independent of n. By (5.8), we obtain 

that 



(5.10) 

As a result, 
follows. □ 



n 



n I* 
T 



+ l^5i;T + c2(r + i) 



are tight random variables, and the lemma 



Proof of Theorem 1. For n g N, let 
sufficiently large n. 



n 



-V2iogn. By (2.15), for 



(5.11) 

For n G N, let 



0, 



(5.12) 

where f3^j are constants chosen in such a way that for all sufficiently large 
n, one has < (e")^, and n^'J^- has integer values, for each i,j and n. 

Below, we write a system of equations for the processes (X", y", Z", 'I'") 
that uniquely defines them. We then let the processes (X", y", Z", ^") be 
defined through (5.1) and (5.2). These processes will then be shown to form 
a SCP, and to satisfy the statement of the theorem. 

Fix iQ G I, jo S J. Set r]Q = 0, and consider the system of equations: 



(5.13) 



i&X 



iGT,tG[r/^i,Cfc"), 
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where is given by (5.8), 

(5.14) Q = inf{t > r/Li : X^{t) - X^{r^l_,) < -7e"} A r", 
and 

teK^r?^), 
^e[a^r?^), 

(5.15) 
where 

(5.16) r,l = inf{t > Q : \\X^{t) - X^{Q)\\ > 3e^} A r", 

(5.17) r'^ = r"A(j", t"" = mi{t >0:\\X''{t) - x*\\ > {e"")^/^}, 

(5.18) a'^ = inf{t>0:||W^"(t)|| >e"}, 
and finally, 

' Xnt) = Xnrn + n~HAf{t) - (r")), t > r", 

^?j{t)=0, iel, jej, t>T^. 

(5.19) 

The above equations mimic the deterministic model (4.19)-(4.23). Note 
carefully that unlike in the case of (4.19)-(4.23), W"^ should not be re- 
garded here as data to the equations, since it depends on past values of 
0" (5.8). However, this will not create problem in applying the results of 
Section 4. Another difference is the definition of the processes for times 
t > r". Note that by definition of r", ||Ty''(t)|| < e" holds for ah t < r". 
This and (5.11) provide a bound that is similar to (4.6) over [0,t"). As 
a result. Lemma 4 implies that given the primitive processes Af and 5[^-, 
the processes X"',Y"',Z"' and and the random times r]^, (J} and r"" are 
uniquely defined by equations (5.13)-(5.19). It also follows from Lemma 4 
that the processes (X", y", Z", ^") satisfy (5.3)-(5.7) over [0,t"). In turn, 
the processes (X", F", Z", ^'") satisfy (2.1)-(2.5) on this interval. It is also 
easy to check that these equations are satisfied for t > r". We show that the 
processes (Xf , Y^", Z", ^'^•) take values in Z+. Since we have proved that 
(2.1)~(2.5) are satisfied, it suffices to show that "^f^ take integer values. By 

construction of tp, take integer values for t S ['r]^_i,Ck)- On the intervals 
Kfcj^fc)) by (4.22), "^fj will be the solution of the system of equations (4.11) 
with integer right-hand sides. In this case, a simple argument (the details of 



xnt) = xrm + wnt) - w^c^) + - 

Y-{t) = {X:{t)-u,-e^)+e,„ 
Z^{t) = {X^{t)-u,-e",)-e,„ 

^"(t) = G(x"(t) - y"(t), 1/ + r - z"(t)). 
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which are omitted) that uses the tree structure of £'ba shows that are all 
integer valued. 

To show that the constructed processes form a SCP, it remains to prove 
that for every t, ^^(t) is measurable on a{X'^{s),A'^{s) :s <t} (cf. Definition 
1). Fix t. We will show in steps (a)-(d) below that the value of ^'"(t) is 
uniquely determined by the sample path A[0, t] := {X"(s), ^"(s) : s G [0, t]}. 

(a) By (2.2), the sample path A[0,t] uniquely determines the sample 
paths Ejej S?iiIo ^F, (^) du),i€l on [0, t]. 

(b) By (5.14), (5.16), A[0,t] along with the value r" A t uniquely deter- 
mine the values r/^ At, At, /c = 1, . . . , K. Thus, by (5.13), (5.15) and (5.19), 
A[0,t] and r" At uniquely determine on [0,t]. Equation (5.8), along with 
(a) above, shows that the same data, A[0,t] and r" At, uniquely determine 
W"'^on[0,t]. 

(c) We next show that A[0,t] determines and on [0,t). Let 
{^i, Wi), (\I'2 1 ^2) be two sample paths that correspond to the same data 
A[0,t]. Argue by contradiction and assume that on [0,t) they do not agree. 
It follows from (b) that the corresponding values of r", that we denote by 
rf and T2, do not agree, and that rf A < t. Without loss of generality, 
assume that rf < A t. Using (b) again, we have that (^'" , Wi ) = (^'2 , W2 ) 
on [0,rf]. In particular, 

(5.20) WI^{t^) = W^{t^). 
Since r" is defined in terms of X"", 

(5.21) fi" A t = A t. 

Recall that cr" is the time when W"' leaves an open set of (5.18). Thus, 
Wf'(rf ) is either inside the open set, in which case rf = rf < a" A CJ2 and, 
therefore, by (5.21) rf = T2, or it is outside the open set, in which case 
Ti = erf, and by (5.20), we have that a" = and r" = In both cases, 
we obtain a contradiction to rf < Tg". We conclude that statement (c) holds. 

(d) By (5.8) and (a) above, W^{t) is uniquely determined by A[0,t] along 
with the values of over [0,t). Hence in view of (c), W'^{t) is determined 
by A[0,t]. Thus, the right continuity of W"' and the definition of o"" imply 
that cj" A t is determined by A[0,t]. Hence, so is A t and by (a), so is 
^'"(t). 

Finally, we show that (2.16) and (2.17) hold for any fixed T G (0, 00) and 
g > 1/2. To this end, note that 

P(f7" < T) < P(||T^"||r > e") = P(n^/^||W^"1|T > logn) ^ 0, 

by Lemma 6. On the event ct"" > T, we can use Theorem 3. On this event, 
for all n sufficiently large, we have T < 72 (^n) A o""-, thus Theorem 3 implies 

rp 

that /q l{e.y"(s)>o} ds < 71 (e"). Since ^ and 71 (0+) = 0, (2.16) follows. 
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The second and third parts of Lemma 5 imply that there is a constant 
C(T) < oo, independent of n, such that \\X^ — x*\\^ < C{T)e'^ on the event 
(t" > T. On this event, we therefore have 

n-^||X" - < C{T)n^^l'^'^-nogn + n-^\\n~^X^^'' - x*\\, 

where the last term on the above display converges to zero by (2.15). Since 
P((t"' > T) — > 1, (2.17) follows. This completes the proof of Theorem 1. □ 
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